Method and apparatus for filtering video

ABSTRACT

An artificial intelligence (AI) system for simulating functions such as recognition, determination, and so forth of a human brain by using a mechanical learning algorithm such as deep learning, or the like, and an application thereof are provided. A method of filtering video by a device is provided. The method includes selecting at least one previous frame preceding a current frame being played from among a plurality of frames included in the video, generating metadata regarding the selected at least one previous frame, predicting harmfulness of at least one next frame to be displayed on the device after playback of the current frame, based on the generated metadata, and filtering the next frame based on the predicted harmfulness.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior application Ser.No. 15/813,752, filed on Nov. 15, 2017, which claims the benefit under35 U.S.C. § 119(a) of a Korean patent application filed on Dec. 19, 2016in the Korean Intellectual Property Office and assigned Serial number10-2016-0173624, and of a Korean patent application filed on Oct. 11,2017 in the Korean Intellectual Property Office and assigned Serialnumber 10-2017-0131643, the entire disclosure of each of which is herebyincorporated by reference.

TECHNICAL FIELD

The present disclosure relates to a method and apparatus for filteringvideo. More particular, the present disclosure relates to an apparatusand method for filtering video to be played according to prediction ofharmful or undesired content.

BACKGROUND

An artificial intelligence (AI) system is a computer system thatimplements human-level intelligence, and allows a machine to learn byitself, make a decision, and become smart unlike an existing rule-basedsmart system. As the AI system is used, the AI system has an improvedrecognition rate and accurately understands user's preference, such thatthe existing rule-based smart system is gradually replaced with adeep-learning-based AI system.

An AI technology includes machine learning (deep learning) and elementtechnologies using machine learning.

Machine learning is an algorithm technique that classifies/learnscharacteristics of input data by itself, and an element technology is atechnology that simulates a function such as recognition, decision,etc., of a human brain by using a machine-learning algorithm such asdeep learning, and includes technical fields such as linguisticunderstanding, visual understanding, inference/prediction, knowledgerepresentation, operation control, and so forth.

The AI technology employs various fields. For example, linguisticunderstanding is a technique that recognizes, and applies/processeshuman languages/texts, and includes natural language processing, machineinterpretation, a conversation system, question and answer, voicerecognition/synthesis, and so forth. Visual understanding is a techniquethat recognizes and processes an object in the same manner as a humanvisual system, and includes object recognition, object tracking, imagesearch, people recognition, scene understanding, space understanding,image enhancement, etc. Inference/prediction is a technique thatdetermines information and performs logical inference and prediction,and includes knowledge/probability-based inference, optimizationprediction, preference-based planning/recommendation, and so forth.Knowledge representation is a technique that automatizes humanexperience information as knowledge data, and includes knowledgeestablishment (data creation/classification), knowledge management (datautilization), and the like. Operation control is a technique thatcontrols autonomous driving of a vehicle and motion of a robot, andincludes motion control (navigation, collision, driving), manipulationcontrol (action control), and so forth.

Deep learning may also be used for a device to filter a harmful imageincluded in video, such that a need exists for a deep learning techniquefor effectively filtering a harmful image a user does not desire towatch.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide a method and apparatus for filtering video.

In accordance with an aspect of the present disclosure, a method offiltering video by a device is provided. The method includes selectingat least one previous frame preceding a current frame being played fromamong a plurality of frames included in the video, generating metadataregarding the selected at least one previous frame, predictingharmfulness of at least one next frame to be displayed on the deviceafter playback of the current frame, based on the generated metadata,and filtering the next frame based on the predicted harmfulness.

In accordance with another aspect of the present disclosure, a devicefor filtering video is provided. The device includes a displayconfigured to display the video, a memory configured to store at leastone instruction, and at least one processor configured, by executing theat least one instruction, is configured to: select at least one previousframe preceding a current frame being played from among the plurality offrames included in the video, generate metadata regarding the selectedprevious frame, predict harmfulness of at least one next frame to bedisplayed on the device after playback of the current frame, based onthe generated metadata, and filter the next frame based on the predictedharmfulness.

In accordance with another aspect of the present disclosure, anon-transitory computer-readable recording medium has recorded thereon aprogram which, when executed by a computer, performs the methodaccording to the first aspect of the embodiment.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 illustrates an example where a device filters video according toan embodiment of the present disclosure;

FIG. 2 is a flowchart of a method of filtering video by a deviceaccording to an embodiment of the present disclosure;

FIG. 3 illustrates metadata regarding previous frames according to anembodiment of the present disclosure;

FIG. 4 illustrates an example where a device compares a harmfulnesslevel with a filtering level to filter video according to an embodimentof the present disclosure;

FIGS. 5A, 5B, and 5C illustrate examples where a filtering level is setaccording to various embodiments of the present disclosure;

FIG. 6 is a flowchart of a method of comparing an expected harmfulnesslevel of a next frame with a preset filtering level according to anembodiment of the present disclosure;

FIG. 7 illustrates an example where metadata regarding a harmful regionof a previous frame is generated according to an embodiment of thepresent disclosure;

FIG. 8 illustrates an example where a next frame is filtered based onmetadata according to an embodiment of the present disclosure;

FIGS. 9 and 10 are block diagrams of a device according to variousembodiments of the present disclosure;

FIG. 11 is a block diagram of a controller according to an embodiment ofthe present disclosure

FIG. 12 is a block diagram of a learner according to an embodiment ofthe present disclosure;

FIG. 13 is a block diagram of a data recognizer according to anembodiment of the present disclosure; and

FIG. 14 illustrates an example where a device and a server learn andrecognize data by interworking with each other according to anembodiment of the present disclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

Some embodiments of the present disclosure may be represented by blockcomponents and various process operations. All or some of suchfunctional blocks may be implemented by various numbers of hardwareand/or software components which perform specific functions. Forexample, functional blocks of the present disclosure may be implementedwith one or more microprocessors or circuit elements for a specificfunction. The functional blocks of the present disclosure may also beimplemented with various programming or scripting languages. Functionalblocks may be implemented as an algorithm executed in one or moreprocessors. Furthermore, the present disclosure may employ any number ofconventional techniques for electronics configuration, signal processingand/or control, data processing and the like. The term “mechanism”,“element”, “means”, or “component” is used broadly and is not limited tomechanical or physical embodiments.

Connecting lines or connecting members between elements shown in thedrawings are intended to merely illustrate functional connections and/orphysical or circuit connections. In an actual device, connectionsbetween elements may be indicated by replaceable or added variousfunctional connections, physical connections, or circuit connections.

Hereinafter, the present disclosure will be described with reference tothe accompanying drawings.

FIG. 1 illustrates an example where a device filters video according toan embodiment of the present disclosure.

Referring to FIG. 1, a device 10 may filter a frame including harmfulcontent from frames included in video 110 being played in the device 10.In an embodiment, a user of the device 10 may preset a type of harmfulcontent (e.g., violence, lasciviousness, and horror) and a filteringlevel used to filter the content, and the device 10 may expectharmfulness of a frame to be displayed after playback of a currentplayed frame based on a type of harmful content to be filtered and afiltering level specific to the type of the harmful content and performfiltering.

For example, if the user does not desire to view a lascivious scene ofthe video 110, the user may set a low filtering level for a‘lasciviousness’ category to make the lascivious scene easily filtered,and if the device 10 determines that a frame to be displayed afterplayback of a currently played frame includes a lascivious scene, thedevice 10 may filter the frame to be displayed.

In an embodiment, frame filtering lowers visibility of harmful contentincluded in a frame and may include processing the frame by using animage filter. For example, the device 10 may filter a frame includingharmful content by blurring or darkening the entire region of the frameor a partial region thereof where the harmful content is displayed.

In an embodiment, frames included in the video 110 may be classifiedinto a current frame 112 currently played on the device 10, at least oneprevious frames 111 displayed on the device 10 before the current frame112, and at least one next frames 113 to be displayed on the device 10after playback of the current frame 112. However, a classificationcriterion of the frames is not limited to this example.

The device 10 may expect harmfulness of the next frame 113 to bedisplayed on the device 10 after playback of the current frame 112, byanalyzing the previous frames 111. In an embodiment, harmfulness of thenext frame 113 may be expected for each of a plurality of categories 121related to harmfulness. For example, the plurality of categories 121 mayinclude ‘violence’, ‘lasciviousness’, and ‘horror’, and the device 10may expect harmfulness of the next frame 113 for each of the ‘violence’,‘lasciviousness’, and ‘horror’ categories.

In an embodiment, the device 10 filters the next frame 113 by comparinga level (not shown) of the expected harmfulness of the next frame 113with a preset filtering level 120. A harmfulness level (not shown)indicates an extent to which harmful content is included in the nextframe 113, and for example, the harmfulness level (not shown) may be setto an integer value and if the device 10 determines that the harmfulnessof the next frame 113 has the highest level, the device 10 may expectthe harmfulness level (not shown) of the next frame 113 as 10. Thefiltering level 120 indicates a level of harmful content of the nextframe 113, which causes filtering of the next frame 113, and may be setin a range similar with a range in which the harmfulness level (notshown) may be set. For example, if the harmfulness level (not shown) isset to an integer value of 0 through 10, the filtering level 120 mayalso be set to an integer value of 0 through 10. When the filteringlevel 120 is set to 7, the next frame 113 may be determined to befiltered if the harmfulness level (not shown) is set to an integer valueof 7 through 10.

In an embodiment, if harmfulness of the next frame 113 is expected foreach of the plurality of categories 121, the device 10 may filter thenext frame 113 by comparing the harmfulness level (not shown) and thefiltering level 120 for the same category with each other.

In an embodiment, the device 10 may filter the next frame 113 if theexpected harmfulness level (not shown) of the next frame 113 is higherthan or equal to the preset filtering level 120. For example, if theharmfulness level of the next frame 113 for the ‘lasciviousness’category is expected as 9 and thus is higher than the filtering level120 for the ‘lasciviousness’ category, which is set to 8, then thedevice 10 may filter the next frame 113.

The device 10 may be, for example, but not limited to, a smart phone, atablet personal computer (PC), a smart television (TV), a personaldigital assistant (PDA), a laptop, a media player, a micro server, aglobal positioning system (GPS) device, an electronic book (e-Book)terminal, a digital broadcasting terminal, a navigation system, a kiosk,an Moving Picture Experts Group phase 1 or phase 2 (MPEG-1 or MPEG-2)audio layer 3 (MP3) player, a digital camera, a wearable device, andother mobile or non-mobile computing devices. The device 10 may alsoinclude various devices capable of receiving a touch input, such as anelectronic board, a touch table, or the like. The device 10 may also bea watch, glasses, a hair band, or a ring, which has a communicationfunction and a data processing function.

FIG. 2 is a flowchart of a method of filtering video by a deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 2, in operation S210, the device 10 selects at leastone of previous frame preceding a currently played current frame fromamong frames included in video. In an embodiment, the device 10 mayselect a plurality of adjacent previous frames having similarity, basedon a data variation between adjacent previous frames included in thevideo. The device 10 may receive the video from an external device or aserver. The video may be input to the device 10 through a camera, etc.,of the device 10.

In operation S220, the device 10 generates metadata regarding theselected previous frame. The metadata may include information fordetermining harmfulness of a next frame. In an embodiment, the device 10may generate the metadata based on at least one of image information,speech information, and text information included in the selectedprevious frame.

For example, the device 10 may extract image characteristics of theselected previous frame, recognize speech included in the selectedprevious frame, and use scenario information of video including theprevious frame, thereby generating information about the number ofpersons included in the previous frame, a gender of a person, an actionof a person, a facial expression of a person, an emotional state of aperson, and a skin color exposure degree as the metadata. However, atype of the metadata is not limited to the above example.

In an embodiment, the device 10 may determine a partial region of theselected previous frame as a harmful region including the harmfulcontent. The device 10 generates metadata regarding the harmful regionthat is the partial region of the previous frame. The device 10generates metadata by extracting image characteristics of the partialregion of the selected previous frame.

In operation S230, the device 10 expects harmfulness of at least onenext frame to be displayed on the device 10 after playback of thecurrent frame, based on the generated metadata.

In an embodiment, the device 10 expects harmfulness of the next framefor each of a plurality of categories related to harmfulness. Forexample, the plurality of categories may include ‘violence’,‘lasciviousness’, and ‘horror’, and the device 10 may expect harmfulnessof the next frame for each of the ‘violence’, ‘lasciviousness’, and‘horror’ categories.

In operation S240, the device 10 filters the next frame based on theexpected harmfulness. In an embodiment, the device 10 filters the nextframe by comparing an expected harmfulness level of the next frame witha preset filtering level. If the harmfulness of the next frame isexpected for each of the plurality of categories, the device 10 mayfilter the next frame by comparing the harmfulness level and thefiltering level for the same category with each other. In an embodiment,the device 10 filters the next frame if the expected harmfulness levelof the next frame is higher than or equal to a preset filtering level.

In an embodiment, the device 10 filters the next frame by using an imagefilter. For example, the device 10 may filter the next frame by blurringor darkening the entire region of the next frame or a partial regionthereof where the harmful content is displayed.

The device 10 may display the filtered next frame on the device 10. Thedevice 10 may transmit the filtered next frame to an external device oran external server.

FIG. 3 illustrates metadata regarding previous frames according to anembodiment of the present disclosure.

Referring to FIG. 3, metadata 320 regarding previous frames 310 mayinclude information for determining harmfulness of a next frame. In anembodiment, the device 10 may generate the metadata 320 based on atleast one of image information, speech information, and text informationincluded in the selected previous frame. However, the metadata 320 shownin FIG. 3 is provided for convenience of description, and the metadata320 generated by the device 10 is not limited to the description.

To generate the metadata 320 regarding the selected previous frames 310,the device 10 may use autocorrelation, a scale-invariant feature (SIFT)method, and a speeded-up robust features (SURF) algorithm as a methodfor extracting image characteristics of the previous frames 310. Thedevice 10 may use a speech recognition algorithm such as dynamic timewarping (DTW), hidden Markov modelling (HMM), a neural network, etc., togenerate the metadata regarding the selected previous frames 310. Thedevice 10 may generate the metadata 320 by using scenario and scriptinformation regarding video. However, the present disclosure is notlimited thereto, and data capable of indicating image characteristicsincluded in a frame and being used to distinguish attributes of imagesmay be included in the metadata.

In an embodiment, the device 10 may extract image characteristics of theselected previous frames 310, recognize speech included in the selectedprevious frames 310, and use scenario information of video including theprevious frames 310, thereby generating information about the number ofpersons included in the previous frames 310, a gender of a person, anaction of a person, a facial expression of a person, an emotional stateof a person, and a skin color exposure degree as the metadata.

For example, if the previous frames 310 show scenes for preparing fortaking a shower, the device 10 may generate, as the metadata 320regarding the previous frames 310, ‘a gender, the number of persons:woman, one, a skin exposure degree: 75%, an action: taking off clothes,a mood: happy, speech information: “Warm.”, scenario information: ashower scene’.

In an embodiment, the device 10 may determine a partial region of theselected previous frames 310 as a harmful region 311 including harmfulcontent. The device 10 generates the metadata 320 for determiningharmfulness of the harmful region 311.

FIG. 4 illustrates an example where a device compares a harmfulnesslevel with a filtering level to filter video according to an embodimentof the present disclosure.

Referring to FIG. 4, frames 410 played on the device 10 may includeprevious frames 411 a and a currently played current frame 412.

The device 10 may select at least one of the previous frames 411 apreceding the current frame 412. In an embodiment, the device 10 mayselect a plurality of adjacent previous frames 411 b having similarity,based on a data variation between adjacent previous frames 411 a.

The device 10 generates metadata 420 regarding the selected previousframes 411 b. In an embodiment, the device 10 may generate the metadata420 based on at least one of image information, speech information, andtext information included in the selected previous frames 411 b.

The device 10 extracts image characteristics of the selected previousframes 411 b, thus generating, as metadata, information about the numberof persons included in the selected previous frames 411 b, a gender of aperson, an action of a person, a facial expression of a person, and askin color exposure degree. For example, the device 10 may generate, asthe metadata 420 regarding the selected previous frames 411 b,information indicating ‘one woman, a skin color exposure degree of 80%,during a shower, a happy facial expression’.

The device 10 expects harmfulness of at least one next frame 413 basedon the generated metadata 420. In an embodiment, the device 10 mayexpect harmfulness of the next frame 413 for each of a plurality ofcategories 431 related to harmfulness. In an embodiment, the pluralityof categories 431 may include ‘violence’, ‘lasciviousness’, and‘horror’, and the device 10 may expect harmfulness of the next frame 413for each of the ‘violence’, ‘lasciviousness’, and ‘horror’ categories.For example, if the metadata 420 regarding the selected previous frames411 b includes ‘one woman, a skin color exposure degree of 80%, during ashower, a happy facial expression’, and thus includes informationindicating lasciviousness, but does not include information indicating‘violence’ or ‘horror’, then the device 10 may expect ‘violence: 0,lasciviousness: 8, horror: 3’ as the harmfulness level of the next frame413 for each category.

The device 10 determines whether to filter the next frame 413 bycomparing an expected harmfulness level 430 with a preset filteringlevel 440. In an embodiment, if harmfulness of the next frame 413 isexpected for each of the plurality of categories 431, the device 10 mayfilter the next frame 413 by comparing the harmfulness level 430 and thefiltering level 440 for the same category with each other. For example,if the harmfulness level 430 of the next frame 413 for the‘lasciviousness’ category is expected as 8 and the filtering level 440for the ‘lasciviousness’ category is set to 3, then the harmfulnesslevel 430 is higher than the filtering level 440 and thus the device 10filters the next frame 413.

Meanwhile, the device 10 adds a new category to a presetharmfulness-related category based on a user input. In an embodiment, ifa new category for expectation is added, the device 10 filters the nextframe 413 by comparing the harmfulness level 430 and the filtering level440 of the next frame 413 for the same category with each other.

The device 10 changes the filtering level 440 for each category based onthe user input. In an embodiment, if the filtering level 440 for aparticular category is changed by the user input, the device 10 filtersthe next frame 413 by comparing the harmfulness level 430 and thefiltering level 440 for the particular category with each other.

The device 10 filters the next frame 413 by comparing the expectedharmfulness level 430 of the next frame 413 with the preset filteringlevel 440. For example, the device 10 may filter the next frame 413 byblurring the entire region of the next frame 413.

In an embodiment, the device 10 filters a preset number of next frames.For example, the device 10 may filter a preset number of next frames byblurring the preset number of next frames.

FIGS. 5A to 5C illustrate examples where a filtering level is setaccording to various embodiments of the present disclosure.

Referring to FIGS. 5A to 5C, the device 10 provides graphic userinterfaces (GUIs) 510 a, 410 b, and 520 for setting a category forexpectation of harmfulness of a next frame.

Referring to FIG. 5A, the device 10 receives a user input 511 forsetting a category of harmfulness through the GUI 510 a to expect theharmfulness of the next frame.

Referring to FIG. 5B, the device 10 provides the GUI 520 in response tothe user input 511 for setting a category of harmfulness. In anembodiment, the device 10 provides a list of preset categories and newlyadded categories through the GUI 520. For example, in addition to presetcategories ‘violence’, ‘lasciviousness’, and ‘horror’, the device 10 mayprovide a new category ‘blood stain’ through the GUI 520.

In an embodiment, the device 10 may receive a user input 521 for addingthe new category ‘blood stain’. In an embodiment, the device 10 mayreceive a user input (not shown) for excluding the categories beingpreset to expect harmfulness through the GUI 520.

Referring to FIG. 5C, the device 10 provides the GUI 410 b in responseto the user input 521 for adding a new category. For example, the device10 may add a ‘blood stain’ category 512 to the categories for expectingharmfulness in response to the user input 521 for adding the newcategory ‘blood stain’. The device 10 provides a list of the preset‘violence’, ‘lasciviousness’, and ‘horror’ categories and the newlyadded ‘blood stain’ category 512 through the GUI 410 b.

The device 10 changes a preset filtering level for a category based on auser input 513. For example, the device 10 may receive the user input513 for changing a filtering level of the ‘violence’ category from ‘5’to ‘0’.

The device 10 may filter a next frame by comparing a harmfulness leveland a filtering level for a newly added category. The device 10 mayfilter the next frame by comparing the changed filtering level andharmfulness level for the particular category with each other.

FIG. 6 is a flowchart of a method of comparing an expected harmfulnesslevel of a next frame with a preset filtering level according to anembodiment of the present disclosure.

Referring to FIG. 6, in operation S602, the device 10 compares anexpected harmfulness level of a next frame with a preset filteringlevel. In an embodiment, the device 10 may compare an expectedharmfulness level of the next frame with a preset filtering level foreach of a plurality of categories related to harmfulness. For example,the device 10 may compare an expected harmfulness level of a next framefor the ‘lasciviousness’ category with a preset filtering level for the‘lasciviousness’ category.

The expected harmfulness level of the next frame may differ fromcategory to category, and the preset filtering level may also differfrom category to category. For example, if the user does not desire towatch a lascivious scene of video, the user may set a low filteringlevel for the ‘lasciviousness’ category and a high filtering level forthe ‘violence’ and ‘horror’ categories.

The harmfulness level of the next frame may also be determined based onmetadata generated using previous frames. For example, if information‘one woman, a skin color exposure degree of 80%, during a shower, ahappy facial expression’ is generated as metadata, the device 10 maydetermine a high harmfulness level of the next frame for the‘lasciviousness’ category and a low harmfulness level of the next framefor the ‘violence’ and ‘horror’ categories.

In operation S604, the device 10 determines whether an expectedharmfulness level for at least one category is higher than a presetfiltering level. If determining that the harmfulness level for the‘lasciviousness’ category is higher than the filtering category for the‘lasciviousness’ category as a result of expectation of the harmfulnesslevel of the next frame to be played, the device 10 proceeds tooperation S608. If the expected harmfulness level for the‘lasciviousness’ category is not higher than the filtering level for the‘lasciviousness’ category, the device 10 proceeds to operation S606.

In operation S604, the device 10 determines whether expected harmfulnesslevels for two or more categories are higher than preset filteringlevels or expected harmfulness levels for arbitrarily combinedcategories are higher than preset filtering levels. For example, thedevice 10 may filter the next frame if harmfulness levels for both the‘violence’ category and the ‘horror’ category are higher than presetfiltering levels.

If determining in operation S604 that an expected harmfulness level forat least one category is not higher than a preset filtering level, thedevice 10 goes to operation S606 not to filter the next frame.

If determining in operation S604 that an expected harmfulness level forat least one category is higher than a preset filtering level, thedevice 10 goes to operation S608 not to filter the next frame.

FIG. 7 illustrates an example where metadata regarding a harmful regionof a previous frame is generated according to an embodiment of thepresent disclosure.

In the following description, a description that overlaps that of FIG. 4will not be provided for convenience.

Referring to FIG. 7, the device 10 may determine a partial region ofselected previous frames 711 as a harmful region 710 a including harmfulcontent. In an embodiment, the device 10 may determine a partial regionof the selected previous frames 711 as the harmful region 710 aincluding harmful content, by extracting image characteristics of theselected previous frames 711. The current frame 712 that is being playedis shown in FIG. 7.

If a plurality of categories related to harmfulness are set, the device10 may determine a partial region of the previous frames 711 includingharmful content indicated by the plurality of categories as the harmfulregion 710 a. For example, if as a plurality of categories, the‘lasciviousness’ and ‘horror’ categories are set, the device 10 maydetermine a partial region of the previous frames 711 including harmfulcontent related to ‘lasciviousness’ and ‘horror’ as the harmful region710 a. The device 10 may determine the harmful region 710 a includingharmful content differently according to types of the plurality of setcategories.

To expect harmfulness of the next frame 713, the device 10 generatesmetadata 720 regarding the harmful region 710 a in place of metadataregarding the entire region of the previous frames 711. The device 10expects a harmfulness level 730 of a harmful region 710 b of the nextframe 713 based on the generated metadata 720 and compares the expectedfiltering level 730 with a filtering level 740. In an embodiment, thedevice 10 compares the expected harmfulness level 730 and the filteringlevel 740 for the same category with each other.

If the expected harmfulness level 730 of the harmful region 710 b of thenext frame 713 is higher than the filtering level 740, the device 10filters the entire next frame 713 or the harmful region 710 b of thenext frame 713. For example, the device 10 may filter the next frame 713by blurring or darkening the entire region or the harmful region 710 bof the next frame 713.

FIG. 8 illustrates an example where a next frame is filtered based onmetadata according to an embodiment of the present disclosure.

A description will not be provided if it overlaps with the descriptionprovided above.

Referring to FIG. 8, in an embodiment, video played on the device 10 mayinclude a frame group 810 including a cruel scene and a second framegroup 820 including a lascivious scene. The first frame group 810 andthe second frame group 820 may include a plurality of adjacent previousframes having similarity, which are selected based on a data variationbetween adjacent previous frames included in the video. A filteringlevel 830 for the ‘lasciviousness’ category may be set low, and thefiltering level 830 for the ‘violence’ and ‘horror’ categories may beset high. For example, if the filtering level 830 for each category isset to an integer value of 0 through 10, the filtering level 830 may beset to ‘violence: 10, lasciviousness: 3, horror: 10’. In this case,first and second next frames 814 and 824 may be filtered if harmfulnesslevels 813 and 823 for the ‘lasciviousness’ category are determined tobe 3 through 10 or the harmfulness levels 813 and 823 for the ‘violence’and ‘horror’ categories are determined to be 10.

In an embodiment, the device 10 generates first metadata 812 regardingfirst previous frames 811 included in the first frame group 810. In anembodiment, the device 10 generates second metadata 822 regarding secondprevious frames 821 included in the second frame group 820.

For example, as the first metadata 812 regarding the first previousframes 811 including a cruel scene, information ‘gender, the number ofpersons: woman, two, man, two, a skin exposure degree: 15%, an action:the man is holding the hair of the woman, mood: man-angry, woman-scared,speech information: man—“Do tell!” woman—“Please help me.”’, etc., maybe generated. For example, as the second metadata 822 regarding thesecond previous frames 821 including a lascivious scene, information‘gender, the number of persons: woman, one, a skin exposure degree: 75%,an action: taking a shower, a mood: happy, speech information: “Warm.”’,etc., may be generated.

In an embodiment, the device 10 expects harmfulness of the first nextframe 814 and the second next frame 824 based on the generated firstmetadata 812 and second metadata 822. In an embodiment, the device 10may expect harmfulness of the first and second next frames 814 and 824for each of the ‘lasciviousness’, ‘violence’, and ‘horror’ categories.

For example, based on the first metadata 812, a first harmfulness level813 of the first frame group 810 including a cruel scene may be expectedfor each category as ‘violence: 9, lasciviousness: 1, horror: 6’ as theharmfulness level of the next frame 413 for each category. Based on thesecond metadata 822, a second harmfulness level 823 of the second framegroup 820 including a lascivious scene may be expected for each categoryas ‘violence: 0, lasciviousness: 7, horror: 0’ as the harmfulness levelof the next frame 413 for each category.

The device 10 determines whether to filter the next frame by comparingan expected harmfulness level of the next frame with a preset filteringlevel. In an embodiment, the device 10 compares the expected firstharmfulness level 813 of the first next frame 814 with the presetfiltering level 830. The device 10 also compares the expected secondharmfulness level 823 of the second next frame 824 with the presetfiltering level 830.

For example, if the first harmfulness level 813 is expected as‘violence: 9, lasciviousness: 1, horror: 6’ and thus is lower than thepreset filtering level 830 ‘violence: 10, lasciviousness: 7, horror: 10’in values corresponding to all of the harmfulness categories, the device10 may not filter the first next frame 814. If the second harmfulnesslevel 823 is expected as ‘violence: 0, lasciviousness: 7, horror: 0’ andthus is higher than the preset filtering level 830 in a valuecorresponding to the ‘lasciviousness’ category, then the device 10 mayfilter the second next frame 824.

If a partial region of the second previous frames 821 is determined as aharmful region 825 a, the device 10 may filter the harmful region 825 bcorresponding to the second next frame 824.

In an embodiment, the device 10 may filter the next frame 824 byblurring or darkening the entire region or a harmful region 825 b of thesecond next frame 824.

FIGS. 9 and 10 are block diagrams of a device according to variousembodiments of the present disclosure.

Referring to FIG. 9, a device 10 according to an embodiment may includea controller 910, an output interface 920, and a memory 930. However,all of the elements shown in FIG. 9 are not essential elements of thedevice 10. More elements or less elements than those shown in FIG. 9 maybe used to implement the device 10.

For example, as shown in FIG. 9, the device 10 according to anembodiment may further include an input interface 1100, a communicator1500, a sensor 1400, and an audio/video (A/V) input interface 1600 inaddition to the controller 1300 and the output interface 1200.

The user input interface 1100 is a means through which a user inputsdata for controlling the device 10. For example, the user inputinterface 1100 may include, but not limited to, a keypad, a dome switch,a touch pad (a capacitive overlay type, a resistive overlay type, aninfrared beam type, a surface acoustic wave type, an integral straingauge type, a piezoelectric effect type, etc.), a jog wheel, a jogswitch, etc.

The user input interface 1100 receives a user input for setting a presetharmfulness-related category and a user input for changing acategory-specific filtering level.

The output interface 1200 outputs an audio signal, a video signal, or avibration signal, and may include a display 1210, an audio outputinterface 1220, and a vibration motor 1230.

The display 1210 displays information processed by the device 10. Forexample, the display 1210 may display frames included in video input tothe device 10 or may display a filtered next frame.

When the display 1210 and a touch pad are constructed as a touch screenin a layer structure, the display 1210 may be used as an input device aswell as an output device. The display 1210 may include at least one of aliquid crystal display (LCD), a thin film transistor (TFT) LCD, anorganic light-emitting diode (OLED), a flexible display, athree-dimensional (3D) display, and an electrophoretic display.According to implementation types of the device 10, the device 10 mayinclude two or more displays 1210. In this case, the two or moredisplays 1210 may be disposed to face each other by using a hinge.

The audio output interface 1220 outputs audio data received from thecommunicator 1500 or stored in the memory 1700. The audio outputinterface 1220 outputs an audio signal related to a function (e.g., acall signal receiving sound, a message receiving sound, an alarm sound,etc.) performed in the device 10. The audio output interface 1220 mayinclude a speaker, a buzzer, or the like.

The vibration motor 1230 outputs a vibration signal. For example, thevibration motor 1230 may output a vibration signal corresponding tooutput of audio data or video data (e.g., a call signal receiving sound,a message receiving sound, etc.). The vibration motor 1230 outputs avibration signal if a touch is input to a touch screen.

The controller 1300 controls an overall operation of the device 10. Forexample, the controller 1300 may control in overall the user inputinterface 1100, the output interface 1200, the sensor 1400, thecommunicator 1500, and the A/V input interface 1600 by executingprograms stored in the memory 1700.

The controller 1300 performs operations of the device 10 disclosed inFIGS. 1 to 4, 5A to 5C, 6 to 8, and 11 to 14.

More specifically, the controller 1300 selects at least one of previousframe preceding a currently played current frame from among framesincluded in video. In an embodiment, the controller 1300 may select aplurality of adjacent previous frames having similarity, based on a datavariation between adjacent previous frames included in the video.

The controller 1300 generates metadata regarding the selected previousframe. In an embodiment, the controller 1300 may generate the metadatabased on at least one of image information, speech information, and textinformation included in the selected previous frame.

In an embodiment, the controller 1300 may determine a partial region ofthe selected previous frame as a harmful region including harmfulcontent. The controller 1300 generates metadata regarding the harmfulregion that is the partial region of the previous frame.

The controller 1300 expects harmfulness of at least one next frame to bedisplayed on the device after playback of the current frame, based onthe generated metadata.

The controller 1300 filters the next frame based on the expectedharmfulness. In an embodiment, the controller 1300 filters the nextframe by comparing an expected harmfulness level of the next frame witha preset filtering level. If the harmfulness of the next frame isexpected for each of the plurality of categories, the controller 1300filters the next frame by comparing the harmfulness level and thefiltering level for the same category with each other. In an embodiment,the controller 1300 filters the next frame if the expected harmfulnesslevel of the next frame is higher than or equal to a preset filteringlevel.

The controller 1300 provides a GUI for setting a category for expectingharmfulness of a next frame. The controller 1300 changes a presetfiltering level for a category based on a user input. The controller1300 may filter the next frame by comparing a harmfulness level and afiltering level of the next frame for a newly added category. Thecontroller 1300 may filter the next frame by comparing the changedfiltering level and harmfulness level for the particular category witheach other.

The controller 1300 compares an expected harmfulness level of the nextframe with a preset filtering level. In an embodiment, the controller1300 determines whether an expected harmfulness level for at least onecategory is higher than a preset filtering level. If determining thatthe expected harmfulness level for at least one category is not higherthan the preset filtering level, the controller 1300 does not filter thenext frame. If determining that the expected harmfulness level for atleast one category is higher than the preset filtering level, thecontroller 1300 filters the next frame.

The sensor 1400 senses a state of the device 10 or a state around thedevice 10, and delivers sensed information to the controller 1300.

The sensor 1400 may include, but not limited to, at least one of amagnetic sensor 1410, an acceleration sensor 1420, atemperature/humidity sensor 1430, an infrared sensor 1440, a gyroscopesensor 1450, a positioning sensor (e.g., a global positioning system(GPS)) 1460, a pressure sensor 1470, a proximity sensor 1480, and ared/green/blue (RGB) sensor (or an illuminance sensor) 1490. A functionof each sensor may be intuitively construed from a name of each sensorby those of ordinary skill in the art, and thus will not be described indetail.

Meanwhile, the communicator 1500 may include one or more elements thatenable communication between the device 10 and the external device (notshown). For example, the communicator 1500 may include a short-rangewireless communication unit 1510, a mobile communication unit 1520, anda broadcasting reception unit 1530.

The short-range wireless communication unit 1510 may include, but notlimited to, a Bluetooth low energy (BLE) communication unit, a nearfield communication (NFC) unit, a wireless local area network (WLAN)communication unit or Wi-Fi communication unit, a ZigBee communicationunit, an infrared data association (IrDA) communication unit, a Wi-Fidirect (WFD) communication unit, an ultra-wideband (UWB) communicationunit, and an Ant+ communication unit.

The mobile communication unit 1520 transmits and receives a radio signalto and from at least one of a base station, an external terminal, and aserver over a mobile communication network. Herein, the radio signal mayinclude various forms of data corresponding to transmission/reception ofa voice call signal, a video communication call signal, or atext/multimedia message.

The broadcasting reception unit 1530 receives a broadcast signal and/orbroadcasting-related information from an external source through abroadcasting channel. The broadcasting channel may include a satellitechannel and a terrestrial channel. According to implementation examples,the device 10 may not include the broadcasting reception unit 1530.

The communicator 1500 transmits and receives information necessary forexpectation of harmfulness of a next frame to and from a head-mounteddisplay (HMD) device (not shown), a server (not shown), and a peripheraldevice (not shown).

The A/V input interface 1600 inputs an audio signal or a video signal,and may include a camera 1610, a microphone 1620, and so forth. Thecamera 1610 obtains an image frame such as a still image or a movingimage in a video communication mode or a photographing mode through animage sensor. The image captured by the image sensor is processed by thecontroller 1300 or a separate image processor (not shown).

An image frame processed by the camera 1610 is stored in the memory 1700or transmitted to an external source through the communicator 1500. Twoor more cameras 1610 may be provided according to a structure aspect ofthe device.

The microphone 1620 receives an external audio signal and processes thereceived signal into electric voice data. For example, the microphone1620 may receive an audio signal from an external device or a speaker.The microphone 1620 uses various noise cancellation algorithms forcanceling noise generated during reception of the external audio signal.

The memory 1700 stores programs for processing and control of thecontroller 1300 and data input to or output from the device 10.

The memory 1700 may include a storage medium of at least one type of aflash memory type, a hard disk type, a multimedia card micro type, acard type memory (e.g., a secure digital (SD) or extreme digital (XD)memory, etc.), a random-access memory (RAM), a static RAM (SRAM), aread-only memory (ROM), an electrically erasable programmable ROM(EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk,an optical disk, and so forth.

The programs stored in the memory 1700 may be classified into aplurality of modules depending on a function thereof, e.g., a userinterface (UI) module 1710, a touch screen module 1720, a notificationmodule 1730, and so forth.

The UI module 1710 provides a specialized UI or graphic UI (GUI)interworking with the first device 1000 for each application. The touchscreen module 1720 senses a touch gesture of a user on a touch screenand delivers information about the touch gesture to the controller 1300.The touch screen module 1720 according to some embodiments recognizesand analyzes a touch code. The touch screen module 1720 is configuredwith separate hardware including a controller.

To sense a touch or proximity touch on the touch screen, various sensorsmay be provided inside or near the touch screen. An example of thesensor for sensing a touch on the touch screen may be a tactile sensor.The tactile sensor refers to a sensor that senses a touch by aparticular object to the extent or larger to which a person feels thetouch. The tactile sensor senses a lot of information such as theroughness of a contact surface, the hardness of a contact object, thetemperature of a contact point, etc.

An example of the sensor for sensing a touch on the touch screen may bea proximity sensor.

The proximity sensor refers to a sensor that detects existence orabsence of an object that approaches or is in proximity to a detectionsurface by using the force of an electromagnetic field or infrared rays,without a mechanical contact. Examples of the proximity sensor mayinclude a transmission optoelectronic sensor, a direct reflectiveoptoelectronic sensor, a mirror reflective optoelectronic sensor, aradio frequency oscillation proximity sensor, an electrostatic capacityproximity sensor, a magnetic proximity sensor, an infrared proximitysensor, and so forth. The user's touch gesture may include a tap, atouch & hold, a double tap, a drag, panning, a flick, a drag & drop, aswipe, and so forth.

The notification module 1730 generates a signal for notifying of anoccurrence of an event of the first device 1000. Examples of the eventoccurring in the first device 1000 may include key signal input, and soforth. The notification module 1730 outputs a notification signal in theform of a video signal through the display 1210, in the form of an audiosignal through the audio output interface 1220, and/or in the form of avibration signal through the vibration motor 1230.

FIG. 11 is a block diagram of a controller according to an embodiment ofthe present disclosure.

Referring to FIG. 11, the controller 1300 may include a data learner1310 and a data recognizer 1320.

The data learner 1310 learns a criterion for predicting harmfulness ofat least one next frame. In an embodiment, the data learner 1310 learnsa criterion by using training video input to the data learner 1310. Thedata learner 1310 may learn a criterion regarding which data included inthe training video is to be used to expect harmfulness of a next frameand regarding how to determine harmfulness of the next frame using data.The data learner 1310 obtains data to be used for learning and appliesthe obtained data to a data recognition model to be described later,thereby learning the criterion for expecting harmfulness of the nextframe.

The data recognizer 1320 expects harmfulness of the next frame based ondata. The data recognizer 1320 expects the harmfulness of the next framefrom data by using the learned data recognition model. The datarecognizer 1320 obtains data according to the criterion that is presetby learning and uses the data recognition model with the obtained dataas an input value, thereby predicting the harmfulness of the next framebased on the data. A result output from the data recognition model withthe obtained data as the input value may be used to update the datarecognition model.

At least one of the data learner 1310 and the data recognizer 1320 maybe manufactured in the form of at least one hardware chip and mounted onan electronic device. For example, at least one of the data learner 1310and the data recognizer 1320 may be manufactured in the form of adedicated hardware chip for artificial intelligence (AI), or may bemanufactured as a part of an existing general-purpose processor (e.g., acentral processing unit (CPU), or an application processor (AP)) or adedicated graphic processor (e.g., a graphic processing unit (GPU)) andmounted on various electronic devices.

In this case, the data learner 1310 and the data recognizer 1320 may bemounted on one electronic device and on separate electronic devices. Forexample, one of the data learner 1310 and the data recognizer 1320 maybe included in one electronic device, and the other may be included in aserver. The data learner 1310 and the data recognizer 1320 may beconnected in a wired or wireless manner, such that model informationestablished by the data learner 1310 may be provided to the datarecognizer 1320 or data input to the data recognizer 1320 may beprovided to the data learner 1310 as additional learning data.

Meanwhile, at least one of the data learner 1310 and the data recognizer1320 may be implemented with a software module. When at least one of thedata learner 1310 and the data recognizer 1320 may be implemented with asoftware module (or a program module including an instruction), thesoftware module may be stored in a non-transitory computer-readablemedium. In this case, at least one software module is provided by anoperating system (OS) or by an application. Alternatively, a part of theat least one software module may be provided by an OS and another partthereof may be provided by an application.

FIG. 12 is a block diagram of a learner according to an embodiment ofthe present disclosure.

Referring to FIG. 12, the data learner 1310 according to someembodiments may include a data obtainer 1310-1, a pre-processor 1310-2,a learning data selector 1310-3, a model learner 1310-4, and a modelevaluator 1310-5.

The data obtainer 1310-1 obtains data needed to expect harmfulness of anext frame.

The data obtainer 1310-1 receives training video to be used forobtaining data. The training video may include a plurality of images (orframes). For example, the data obtainer 1310-1 may receive video througha camera of an electronic device including the data learner 1310 or anexternal camera (e.g., a closed-circuit television (CCTV), a black box,etc.) capable of communicating with the electronic device including thedata learner 1310. Herein, the camera may include one or more imagesensors (e.g., a front sensor or a rear sensor), a lens, an image signalprocessor (ISP), or a flash (e.g., an LED, a xenon lamp, etc.).

For example, the data obtainer 1310-1 may obtain speech data, videodata, text data, or biometric signal data included in the trainingvideo. The data obtainer 1310-1 may receive data through an input device(e.g., a microphone, a camera, a sensor, etc.) of the electronic device.Alternatively, the data obtainer 1310-1 obtains data through an externaldevice capable of communicating with the electronic device.

The pre-processor 1310-2 pre-processes the obtained data, such that theobtained data may be used in learning for expecting harmfulness of thenext frame. The pre-processor 1310-2 processes the obtained data into apreset format, such that the model learner 1310-4 may use the obtaineddata in learning for expecting harmfulness.

For example, the pre-processor 1310-2 extracts and identifies speechdata, video data, text data, or biometric signal data included in theinput training video, and cumulatively learns characteristics and resultvalue extracted from the input data, thereby learning a criterion forexpecting the harmfulness of the next frame. In this case, thepre-processor 1310-2 may extract and identify speech data, video data,text data, or biometric signal data of adjacent previous frames havingsimilarity based on a data variation between adjacent previous framesincluded in the training video. The pre-processor 1310-2 may alsoextract and identify speech data, video data, text data, or biometricsignal data regarding a harmful region that is a partial region ofprevious frames included in the input training video.

The learning data selector 1310-3 selects data needed for learning frompre-processed data. The selected data may be provided to the modellearner 1310-4. The learning data selector 1310-3 selects data neededfor learning from pre-processed data, according to a preset criterionfor predicting harmfulness of the next frame. The learning data selector1310-3 may also select data according to a criterion that is preset bylearning of the model learner 1310-4.

The learning data selector 1310-3 selects data for predictingharmfulness of the next frame from the pre-processed data. If a categoryrelated to harmfulness is preset, the learning data selector 1310-3selects data for predicting harmfulness of the next frame for eachpreset category.

The model learner 1310-4 learns a criterion regarding how to predictharmfulness of the next frame based on learning data. The model learner1310-4 may also learn a criterion regarding which learning data is to beused to predict harmfulness of the next frame.

For example, if a plurality of categories related to harmfulness areset, the model learner 1310-4 may learn a criterion regarding thecategory ‘lasciviousness’, ‘horror’, or ‘violence’ category and acriterion regarding a harmfulness level in a specificharmfulness-related category.

The model learner 1310-4 learns a data recognition model used to predictharmfulness of the next frame using learning data. In this case, thedata recognition model may be previously established. For example, thedata recognition model may be previously established using input basiclearning data (e.g., sample words, etc.).

The data recognition model may be established based on an applicationfield of the recognition model, a purpose of learning, computerperformance of a device, etc. The data recognition model may be basedon, for example, a neural network. For example, a model such as, but notlimited to, a deep neural network (DNN), a recurrent neural network(RNN), a bidirectional recurrent deep neural network (BRDNN), or thelike may be used as the data recognition model.

Various embodiments, if there are a plurality of data recognition modelsestablished in advance, the model learner 1310-4 determines a datarecognition model having a high correlation between input learning dataand basic learning data as a data recognition model to be learned. Inthis case, the basic learning data may be classified in advanceaccording to a data type, and the data recognition model may beestablished in advance for each data type. For example, the basiclearning data may be classified depending on various criteria such as aregion where learning data is generated, a time in which learning datais generated, a size of learning data, a genre of learning data, agenerator of learning data, a type of an object in learning data, and soforth.

The model learner 1310-4 may learn the data recognition model using alearning algorithm such as error back-propagation or gradient descent.

The model learner 1310-4 causes the data recognition model to learnusing supervised learning having learning data as an input value. Themodel learner 1310-4 may cause the data recognition model to learn usingunsupervised learning in which the data recognition model discovers acriterion for predicting harmfulness of a next frame by learning a typeof data needed for predicting the harmfulness of the next frame withoutseparate supervision. The model learner 1310-4 learns the datarecognition model using reinforcement learning based on a feedbackregarding whether a prediction result of the harmfulness of the nextframe based on learning is correct or not.

Once the data recognition model is learned, the model learner 1310-4stores the learned data recognition model. In this case, the modellearner 1310-4 stores the learned data recognition model in a memory ofan electronic device including the data recognizer 1320. Alternatively,the model learner 1310-4 stores the learned data recognition model in amemory of an electronic device including the data recognizer 1320 to bedescribed later. Alternatively, the model learner 1310-4 stores thelearned data recognition model in a memory of a server wiredly orwirelessly connected with an electronic device.

In this case, the memory in which the learned data recognition model isstored may also store an instruction or data related to at least oneother element of the electronic device. The memory may also storesoftware and/or programs. The program may include a kernel, middleware,an application programming interface (API), and/or an applicationprogram (or “application”), and the like.

If a recognition result output after input of evaluation data to thedata recognition model fails to satisfy a predetermined criterion, themodel evaluator 1310-5 may cause the model learner 1310-4 to learnagain. In this case, the evaluation data may be preset data forevaluating the data recognition model.

For example, the model evaluator 1310-5 may evaluate that thepredetermined criterion is not satisfied if among recognition results ofthe learned data recognition model regarding evaluation data, the numberor rate of evaluation data having inaccurate recognition results exceedsa preset threshold value. For the predetermined criterion being definedas a rate of 2%, if the learned data recognition model outputs wrongrecognition results for 20 or more evaluation data among a total of 1000evaluation data, then the model evaluator 1310-5 may evaluate that thelearned data recognition model is not proper.

The evaluation data may be derived from a user's comment input. Forexample, the user may input a comment message indicating satisfaction ordissatisfaction with an output recognition result. The comment input mayinclude user's feedback information regarding the output recognitionresult.

Meanwhile, if there are a plurality of learned data recognition models,the model evaluator 1310-5 evaluates whether each learned datarecognition model satisfies the predetermined criterion, and determinesa learned data recognition model satisfying the predetermined criterionas a final data recognition model. In this case, if a plurality oflearned data recognition models satisfy the predetermined criterion, themodel evaluator 1310-5 determines preset any one model or apredetermined number of models as a final data recognition model orfinal data recognition models in a higher evaluation grade order.

At least one of the data obtainer 1310-1, the pre-processor 1310-2, thelearning data selector 1310-3, the model learner 1310-4, and the modelevaluator 1310-5 may be manufactured in the form of at least onehardware chip and mounted on the electronic device. For example, atleast one of the data obtainer 1310-1, the pre-processor 1310-2, thelearning data selector 1310-3, the model learner 1310-4, and the modelevaluator 1310-5 may be manufactured in the form of a dedicated hardwarechip for AI, or may be manufactured as a part of an existinggeneral-purpose processor (e.g., a CPU or an application processor (AP))or a dedicated graphic processor (e.g., a GPU) and mounted on variouselectronic devices.

The data obtainer 1310-1, the pre-processor 1310-2, the learning dataselector 1310-3, the model learner 1310-4, and the model evaluator1310-5 may be mounted on one electronic device or on separate electronicdevices, respectively. For example, some of the data obtainer 1310-1,the pre-processor 1310-2, the learning data selector 1310-3, the modellearner 1310-4, and the model evaluator 1310-5 may be included in theelectronic device or some others thereof may be included in a server.

At least one of the data obtainer 1310-1, the pre-processor 1310-2, thelearning data selector 1310-3, the model learner 1310-4, and the modelevaluator 1310-5 may be implemented with a software module. When atleast one of the data obtainer 1310-1, the pre-processor 1310-2, thelearning data selector 1310-3, the model learner 1310-4, and the modelevaluator 1310-5 is implemented with a software module (or a programmodule including an instruction), the software module may be stored in anon-transitory computer-readable medium. In this case, at least onesoftware module is provided by an OS or by an application.Alternatively, a part of the at least one software module may beprovided by an OS and another part thereof may be provided by anapplication.

FIG. 13 is a block diagram of a data recognizer according to anembodiment of the present disclosure.

Referring to FIG. 13, the data recognizer 1320 according to someembodiments may include a data obtainer 1320-1, a pre-processor 1320-2,a recognition data selector 1320-3, a recognition result provider1320-4, and a model updater 1320-5.

The data obtainer 1320-1 obtains data needed for predicting harmfulnessof the next frame, and the pre-processor 1320-2 pre-processes theobtained data such that the data obtained for predicting the harmfulnessof the next frame may be used. The pre-processor 1320-2 processes theobtained data into a preset format, such that the recognition resultprovider 1320-4 may use the data obtained for expecting harmfulness ofthe next frame.

The recognition data selector 1320-3 selects the data needed forpredicting the harmfulness of the next frame from the pre-processeddata. The selected data may be provided to the recognition resultprovider 1320-4. The recognition data selector 1320-3 selects the entirepre-processed data or a part thereof, according to a preset criterionfor predicting harmfulness of the next frame. The recognition dataselector 1320-3 may also select data according to a criterion that ispreset by learning of the model learner 1310-4.

The recognition result provider 1320-4 applies the selected data to thedata recognition model to predict the harmfulness of the next frame. Therecognition result provider 1320-4 provides a recognition result basedon a data recognition purpose. The recognition result provider 1320-4applies the selected data to the data recognition model by using dataselected by the recognition data selector 1320-3 as an input value. Therecognition result may be determined by the data recognition model.

For example, a recognition result of video may be provided in the formof a text, audio, video, an image, or an instruction (e.g., anapplication execution instruction, a module function executioninstruction, etc.). The recognition result may provide information aboutthe next frame included in the video, such as ‘lasciviousness’,‘violence’, and ‘horror’ in the form of a text, audio, video, an image,an instruction, etc.

The model updater 1320-5 updates the data recognition model based onevaluation with respect to the recognition result provided by therecognition result provider 1320-4. For example, the model updater1320-5 provides the recognition result provided by the recognitionresult provider 1320-4 to the model learner 1310-4, allowing the modellearner 1310-4 to update the data recognition model.

At least one of the data obtainer 1320-1, the pre-processor 1320-2, therecognition data selector 1320-3, the recognition result provider1320-4, and the model updater 1320-5 may be manufactured in the form ofat least one hardware chip and mounted on the electronic device. Forexample, at least one of the data obtainer 1320-1, the pre-processor1320-2, the recognition data selector 1320-3, the recognition resultprovider 1320-4, and the model updater 1320-5 may be manufactured in theform of a dedicated hardware chip for AI, or may be manufactured as apart of an existing general-purpose processor (e.g., a CPU or an AP) ora dedicated graphic processor (e.g., a GPU) and mounted on variouselectronic devices.

The data obtainer 1320-1, the pre-processor 1320-2, the recognition dataselector 1320-3, the recognition result provider 1320-4, and the modelupdater 1320-5 may be mounted on one electronic device or on separateelectronic devices, respectively. For example, some of the data obtainer1320-1, the pre-processor 1320-2, the recognition data selector 1320-3,the recognition result provider 1320-4, and the model updater 1320-5 maybe included in the electronic device or some others thereof may beincluded in a server.

At least one of the data obtainer 1320-1, the pre-processor 1320-2, therecognition data selector 1320-3, the recognition result provider1320-4, and the model updater 1320-5 may be implemented with a softwaremodule. When at least one of the data obtainer 1320-1, the pre-processor1320-2, the recognition data selector 1320-3, the recognition resultprovider 1320-4, and the model updater 1320-5 is implemented with asoftware module (or a program module including an instruction), thesoftware module may be stored in a non-transitory computer-readablemedium. In this case, at least one software module is provided by an OSor by an application. Alternatively, a part of the at least one softwaremodule may be provided by an OS and another part thereof may be providedby an application.

FIG. 14 illustrates an example where a device and a server learn andrecognize data by interworking with each other, according to anembodiment of the present disclosure.

Referring to FIG. 14, a server 20 learns a criterion for predictingharmfulness of the next frame, and the device 10 predicts theharmfulness of the next frame based on a learning result by the server20. The server 20 includes a data recognizer 2300, which may include adata obtainer 2310, pre-processor 2320, learning data selector 2330,model learner 2340 and model evaluator 2350.

In this case, a model learner 2340 of the server 20 performs functionsof the data learner 1310 shown in FIG. 11. The model learner 2340 of theserver 20 may learn a criterion regarding which data is to be used toexpect harmfulness of the next frame and regarding how to predictharmfulness of the next frame using data. The model learner 2340 obtainsdata to be used for learning and applies the obtained data to a datarecognition model to be described later, thereby learning the criterionfor expecting harmfulness of the next frame.

The recognition result provider 1320-4 of the device 10 predicts theharmfulness of the next frame by applying the data selected by therecognition data selector 1320-3 to the data recognition model generatedby the server 20. For example, the recognition result provider 1320-4 ofthe device 10 may transmit the data selected by the recognition dataselector 1320-3 to the server 20 and request the server 20 to predictthe harmfulness of the next frame by applying the data selected by therecognition data selector 1320-3 to the recognition model. Therecognition result provider 1320-4 receives information about theharmfulness of the next frame, predicted by the server 20, from theserver 20.

For example, the device 10 may generate metadata regarding a previousframe and transmit the metadata to the server 20. The device 10 receivesinformation about the predicted harmfulness of the next frame from theserver 20.

The recognition result provider 1320-4 of the device 10 receives therecognition model generated by the server 20 and predicts theharmfulness of the next frame by using the received recognition model.In this case, the recognition result provider 1320-4 of the device 10predicts the harmfulness of the next frame by applying the data selectedby the recognition data selector 1320-3 to the data recognition modelreceived from the server 20.

An embodiment may be implemented with a recording medium including acomputer-executable command such as a computer-executable programmingmodule. A computer-readable recording medium may be an available mediumthat is accessible by a computer, and includes all of a volatile medium,a non-volatile medium, a separated medium, and a non-separated medium.The computer-readable recording medium may also include both a computerstorage medium and a communication medium. The computer storage mediumincludes all of a temporary medium, a non-temporary medium, a separatedmedium, and a non-separated medium, which is implemented by a method ortechnique for storing information such as a computer-readable command, adata structure, a programming module, or other data. The communicationmedium includes a computer-readable command, a data structure, aprogramming module, or other data of a modulated data signal likecarriers, or other transmission mechanisms, and includes an informationdelivery medium.

In the specification, the term “unit” may be a hardware component like aprocessor or a circuit, and/or a software component executed by ahardware component like a processor.

Those of ordinary skill in the art to which the present disclosurepertains will appreciate that the present disclosure may be implementedin different detailed ways without departing from the technical spiritor essential characteristics of the present disclosure. Accordingly, theaforementioned embodiments should be construed as being onlyillustrative, but should not be constructed as being restrictive fromall aspects. For example, each element described as a single type may beimplemented in a distributed manner, and likewise, elements described asbeing distributed may be implemented as a coupled type.

The scope of the present disclosure is defined by the following claimsrather than the detailed description, and the meanings and scope of theclaims and all changes or modified forms derived from their equivalentsshould be construed as falling within the scope of the presentdisclosure.

It should be understood that various embodiments described herein shouldbe considered in a descriptive sense only and not for purposes oflimitation. Descriptions of features or aspects within each embodimentshould typically be considered as available for other similar featuresor aspects in other embodiments.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. A computing device for providing information on avideo, the computing device comprising: a memory comprising anartificial intelligence model trained with a plurality of videos; and atleast one processor operatively coupled to the memory and configured to:apply the artificial intelligence model trained with the plurality ofvideos to a video, based on the applying of the artificial intelligencemodel trained with the plurality of videos to the video, obtain, for oneor more portions of the video, a plurality of scores related to whetherthe one or more portions of the video has harmful content, each of theplurality of scores corresponding to a different one of a plurality ofcategories, based on the plurality of scores and a plurality ofpredetermined thresholds, determine whether the one or more portions ofthe video has harmful content, each of the plurality of predeterminedthresholds corresponding to a different one of the plurality ofcategories, and provide at least one portion of the video having harmfulcontent among the one or more portions of the video, based on adetermination that the at least one portion of the video has harmfulcontent, wherein each of the at least one portion of the video havingharmful content is provided separately from any other portion of thevideo.
 2. The computing device of claim 1, wherein each of the one ormore portions of the video include at least one frame of the video. 3.The computing device of claim 1, wherein at least one of the pluralityof categories relates to a sexual characteristic.
 4. The computingdevice of claim 1, wherein if at least one score of the plurality ofscores for a portion of the video among the one or more portions of thevideo is higher than a corresponding predetermined threshold, theportion of the video is determined as having harmful content.
 5. Thecomputing device of claim 1, wherein at least one of the plurality ofpredetermined thresholds is customizable by a user.
 6. The computingdevice of claim 1, wherein the computing device is a server, and whereinthe video is received from an external device.
 7. The computing deviceof claim 1, wherein all of the plurality of scores are within a samepredetermined range of scores.
 8. The computing device of claim 1,wherein each of the one or more portions of the video is determined asone of having harmful content or not having harmful content.
 9. A methodfor providing information on a video by a computing device, the methodcomprising: applying, by at least one processor, an artificialintelligence model trained with a plurality of videos to a video; basedon the applying of the artificial intelligence model trained with theplurality of videos to the video, obtaining for one or more portions ofthe video, by the at least one processor, a plurality of scores relatedto whether the one or more portions of the video has harmful content,each of the plurality of scores corresponding to a different one of aplurality of categories; based on the plurality of scores and aplurality of predetermined thresholds, determining, by the at least oneprocessor, whether the one or more portions of the video has harmfulcontent, each of the plurality of predetermined thresholds correspondingto a different one of the plurality of categories; and providing, by theat least one processor, at least one portion of the video having harmfulcontent among the one or more portions of the video, based on adetermination that the at least one portion of the video has harmfulcontent, wherein each of the at least one portion of the video havingharmful content is provided separately from any other portion of thevideo.
 10. The method of claim 9, wherein each of the one or moreportions of the video include at least one frame of the video.
 11. Themethod of claim 9, wherein at least one of the plurality of categoriesrelates to a sexual characteristic.
 12. The method of claim 9, whereinif at least one score of the plurality of scores for a portion of thevideo among the one or more portions of the video is higher than acorresponding predetermined threshold, the portion of the video isdetermined as having harmful content.
 13. The method of claim 9, whereinat least one of the plurality of predetermined thresholds iscustomizable by a user.
 14. The method of claim 9, wherein the computingdevice is a server, and wherein the video is received from an externaldevice.
 15. The method of claim 9, wherein all of the plurality ofscores are within a same predetermined range of scores.
 16. The methodof claim 9, wherein each of the one or more portions of the video isdetermined as one of having harmful content or not having harmfulcontent.
 17. A non-transitory computer computer-readable recordingmedium having recorded thereon a program, which when executed by atleast one processor of a computing device, causes the least oneprocessor to perform a method for providing information on a video, themethod comprising: applying the artificial intelligence model trainedwith the plurality of videos to a video; based on the applying of theartificial intelligence model trained with the plurality of videos tothe video, obtaining, for one or more portions of the video, a pluralityof scores related to whether the one or more portions of the video hasharmful content, each of the plurality of scores corresponding to adifferent one of a plurality of categories; based on the plurality ofscores and a plurality of predetermined thresholds, determining whetherthe one or more portions of the video has harmful content, each of theplurality of predetermined thresholds corresponding to a different oneof the plurality of categories; and providing at least one portion ofthe video having harmful content among the one or more portions of thevideo, based on a determination that the at least one portion of thevideo has harmful content, wherein each of the at least one portion ofthe video having harmful content is provided separately from any otherportion of the video.
 18. The non-transitory computer computer-readablerecording medium of claim 17, wherein each of the one or more portionsof the video include at least one frame of the video.
 19. Thenon-transitory computer computer-readable recording medium of claim 17,wherein at least one of the plurality of categories relates to a sexualcharacteristic.
 20. The non-transitory computer computer-readablerecording medium of claim 17, wherein if at least one score of theplurality of scores for a portion of the video among the one or moreportions of the video is higher than a corresponding predeterminedthreshold, the portion of the video is determined as having harmfulcontent.
 21. The non-transitory computer computer-readable recordingmedium of claim 17, wherein at least one of the plurality ofpredetermined thresholds is customizable by a user.
 22. Thenon-transitory computer computer-readable recording medium of claim 17,wherein the computing device is a server, and wherein the video isreceived from an external device.
 23. The non-transitory computercomputer-readable recording medium of claim 17, wherein all of theplurality of scores are within a same predetermined range of scores. 24.The non-transitory computer computer-readable recording medium of claim17, wherein each of the one or more portions of the video is determinedas one of having harmful content or not having harmful content.